Are Ground States of 3d ± J Spin Glasses ultrametric ? 
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Ground states of 3d EA Ising spin glasses are calculated for 
sizes up to 14 3 using a combination of a genetic algorithm and 
Cluster-Exact Approximation. Evidence for an ultrametric 
structure is found by studying triplets of independent ground 
states where one or two values of the three overlaps are fixed. 
Keywords (PACS-codes): Spin glasses and other random 
models(75.10.Nr), Numerical simulation studies (75.40.Mg), 
General mathematical systems (02.10.Jf). 
Introduction The behavior of the Edwards-Anderson 
(EA) ± J Ising spin glass with short range (i.e. realistic) 
interactions is still not well understood. Introduction to 
spin glasses can be found for example in [QJ^]. The EA 
Ising spin glass is a system of N spins o.i = ±1, described 
by the Hamiltonian 

H = - ^2 JijViVj (!) 

The sum goes over nearest neighbors. In this let- 
ter we consider 3d cubic systems with periodic boundary 
conditions, N = L 3 spins and the exchange interactions 
(bonds) take = ±1 with equal probability under the 
constraint X)<ij> Jij = 0- 

This work addresses the question whether the ground 
states of this system exhibit an ultrametric structure: 
The distances d Q/3 between states do not only satisfy the 
triangular inequality d a/3 < d ai +d 7 ^ but the stronger ul- 
trametric inequality d a @ < max(cP 7 , d 1 ^) as well. For an 
introduction to ultrametricity see || . The mean field so- 
lution j| of the infinite-dimensional SK-model || shows 
an ultrametric state structure [p|j7|| . Numerical work on 
the subject can be found in ||p|]. For finite dimensional 
systems numerical evidence for ultrametricity at finite 
temperature but below the transition Temperature Tq 
was found in four dimensions ]To| , |Tl[] . First attempts to 
find ultrametricity in three dimensions by simulation at 
finite temperature are given in [r^JT^ |. 
Here the first time ground states of realistic spin glasses 
are analyzed regarding their ultrametric structure. The 
ground state structure has a strong influence on the over- 
all behavior of a system: an ultrametric ground state 
structure implies a complex free energy landscape so that 
no efficient variant of the usual cluster algorithms exists, 
i.e. that there is a critical slowing down fll4|| . 
In this letter we show our results for the direct calcu- 
lation of spin glass ground states using a hybrid of ge- 
netic algorithms p5|Jl^ ] and Cluster-Exact Approxima- 
tion (CEA) Because the computation of spin glass 



ground states belongs to the class of NP-hard problems, 
it is a tough computational task. Using this new algo- 
rithms it is possible the first time to calculated ground 
states of adequate size (up to L = 14) and with sufficient 
statistics (especially for the largest sizes). It is possible 
to calculate many strictly statistical independent config- 
urations (replicas). In contrast to Monte Carlo methods 
one does not encounter ergodicity problems. It is impor- 
tance to notice that no kind of temperature is involved 
in our method. 

Observables For a fixed realization J = {Jij} of the 
exchange interactions and two replicas {cf}j{cf}, the 
overlap |J] is defined as 

«°*^£*f*f ( 2 ) 

i 

The ground state of a given realization is characterized 
by the probability density Pj(q). Averaging over the 
realizations J, denoted by [■]„„, results in (Z = number 
of realizations) 

P(q) = [Pj(q)U = ^Pj(q) ( 3 ) 
./ 

Because no external field is present the densities are sym- 
metric: Pj{q) = Pj(—q) and P(q) = P(—q). So we cal- 
culate only functions Pj (\q\) and P(\q\)- 
The overlap measures the distance between two states. 
This can be reflected by defining a distance function 

d aP = 0.5(1 - q aP ) (4) 

with < d a P < 1. For three replicas a, (3, 7 the usual 
triangular inequality reads d a ^ < d ai + d l13 . Expressed 
in terms of q it becomes 

q a ? > q a ~< + qiP - 1 (5) 

In an ultrametric space || the triangular inequality is re- 
placed by a stronger one d a P < max(cP 7 , d 1 ^) or equiv- 
alently 

q afi >mm(q a ^,q^) (6) 

An example of an ultrametric space is the set of leaves of 
a binary tree: The distance between two leaves is defined 
by the number of edges on a path between the leaves. 
Let qi < <72 < 93 be the overlaps q af} , q Q7 , q lf3 ordered 
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according their sizes. By writing the smallest overlap on 
the left side in Equation @, one realizes that two of the 
overlaps must be equal and the third may be larger or 
the same: qi = Q2 < 93 

In a finite size system this relation may be violated. We 
use two ways of determining whether ground states of 
realistic spin glasses become more and more ultrametric 
with increasing size L: 

• The difference 



40 independent runs were made (up to 80 for some large 
systems). Each run resulted in one configuration, which 
was stored, if it exhibited the ground state energy. For 
L = 14 this resulted in an average of n gs — 14.9 states per 
realization having the lowest energy while for L — 3 on 
average n gs — 39.97 states were stored. This reduction of 
n gs means that with increasing system size true ground 
states are harder to find, but not that the number of 
existing ground states is reduced: 



Sq = q2- qi (7) 

is calculated for all triplets. Because we want to 
exclude the influence of the absolute size of the 
overlaps the third overlap is fixed: q^ = q/i X - 
In practice only overlap triples are used where 
<?3 € [q/ix, qfix2\ holds to obtain sufficient statis- 
tics . With increasing size L the distribution P(5q) 
should tend to a Dirac delta function ^ . 

• If two overlaps are fixed (q ai = q^ 1 = in prac- 
tice g" 7 ,^ 7 S [qfix,<lfix2]), equation (|) implies 
q = q a/3 > 2qfi x — 1 while ultrametricity implies 
q > qjix which is stronger if qfi x < 1 p0[ . The 
distribution P2-fi X (q) of the third overlap is used 
to characterize the ultrametricity of a system. The 
fraction of the distribution outside [qfix, qEA] 

Il = J P 2 -fix(q)(q - qjix) 2 dq (8) 
+ / P2-fix{q){q - qEA) 2 dq 

J qEA 

(sec p~C|] ) should vanish for L — > 00 in an ultramet- 
ric system. 

Results We performed ground state calculations for 
sizes L = 3, 4, 5, 6, 8, 10, 12, 14. For each size we used 
different parameter sets, which were determined in a way, 
that no decrease of the energy could be found by doubling 
the running time for some sample systems. Using our pa- 
rameters results roughly in an exponential increase of the 
running time as function of L. One L = 14 run needs typ- 
ically 540 CPU-minutes on a 80MHz PPC601 processor 
(70 CPU-minutes for L = 12, . . ., 0.2 CPU-seconds for 
L = 3). Details of the algorithm, simulation parameters 
and more results will be given in ^M . 
For small system sizes L = 4,6 we could compute for 
200 randomly selected systems exact ground states with 
a Branch-and-Cut method |l^,|2^| using a program which 
generously was made available by the group of M. Jiinger 
in Cologne. In ALL cases our method found the exact 
ground states as well! So we are pretty sure that our 
algorithm computes true ground states or at least states 
very close to true ground states even for larger systems. 
We calculated from 136 realizations for L = 14 up to 
8900 realizations for L = 3. For each realization up to 
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FIG. 1. Distribution of overlaps -P(|q|) for ground states of 
3d ± J Ising spin glass for L — 6, 12. Only for large values 
of q a difference is visible, so even for large systems there is 
a finite probability of overlap q = 0. The lines are guides for 
the eyes only. 

In fig. Qthe probability density of the overlap is displayed 
for L = 6 and L = 12. Each realization enters the sum 
with the same weight, even if different numbers of ground 
states were available for the calculation of Pj(\q\). Only 
a small difference for high q- values can be observed. But 
especially for \q\ < 0.8 no significant reduction in the 
probability is visible. So with increasing sizes the width 
of the distribution remains finite ]2l| ] . It means that re- 
alistic spin glasses have many arbitrary different ground 
states which are arranged in a complex structure. 
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FIG. 2. Distribution P(Sq) for different system sizes 
L — 4, 10, 14 where Sq — qi — q\ and qi < qi < </3 are triplets 
of absolute values of overlaps from independent triplets of 
ground states. Only triplets with q^ € [0.5, 0.6] are used. For 
a infinite ultrametric system Sq = holds. With increasing 
system size the distributions get closer to q — indicating the 
increasing ultrametricity of the ground states. The lines are 
guides for the eyes only. 

To investigate whether this structure is even ultrametric 
we have calculated the quantity Sq (see equation (]?])) for 
all possible triplets with q^ £ [0.5,0.6]. To improve the 
statistics we used the absolute value of all overlaps. The 
distribution P(5q) is show in fig. || for L — 4, 10, 14. 
Each realization enters the distribution with the same 
weight. With increasing system size the distributions get 
closer to q = 0, indicating that the systems become more 
and more ultrametric. It is important to notice that the 
change in P(8q) is not due to a change of P(q) itself as 
it could not be excluded in Since the shape of P(q) 
does not change very much with system size the effect on 
P(Sq) is caused by the increasing ultrametricity of the 
systems. 



FIG. 3. Average value of Sq as function of system size L 
where Sq = q2 — qi and q 1 < qi < q-j, are triplets of absolute 
values of overlaps from independent triplets of ground states. 
Only triplets with 33 € [0.5, 0.6] are used. With increasing sys- 
tem size the average decreases, which indicates the increasing 
ultrametricity of the ground states. The straight line repre- 
sents the function (5q)(L) = 0.235 x L" 255 . 

The same result is obtained by computing the average 
values of Sq as function of the size L (see fig. ||). One 
gets a similar figure by computing the variances of the 
distributions, but it is not shown here. The number of 
realizations is to small too perform a reasonable fit of 
the form (5q)(L) = (Sq) oo + cL~ a . So no decision is 
possible yet whether the average value converges to zero 
or not. We only provide the result of a fit with foo set to 
zero. Then we get c = 0.235(2) and a = 0.255(3). Since 
the data has a small negative curvature the assumption 
{Sq) 00 = seems reasonable. 
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FIG. 4. Distribution P2-fi X (q) for different system sizes 
L — 4, 8, 12 where q £ {qi, </2, 53} and q\ < 52 < 93 are triplets 
of overlaps from independent triplets of ground states. Only 
q- values of triplets are used where the two other overlaps are 
within the interval [0.5,0.6]. Then for a infinite ultrametric 
system q > 0.5 holds, while for a metric system just q > 
must hold. The small inset shows the part q € [0.0, 0.5] for 
L — 4,6, 8, 10, 12 (from left to right). With increasing system 
size the fraction of the distribution below 0.5 shrinks, so the 
systems become more and more ultrametric. The lines are 
guides for the eyes only. 

By fixing two of the three overlaps of a triplet we have an- 
other way of checking ultrametricity. We took all triplets 
where two arbitrary overlaps fell into the interval [0.5, 0.6] 
The resulting distributions P2-fi X (q) of the third remain- 
ing overlap is shown in fig. |] for L = 4, 8, 12. The trian- 
gular inequality gives q > while ultrametricity leads to 
q > 0.5. The inset magnifies the values of q £ [0.0,0.5] 
for L = 4,6,8,10,12 (from left to right). The fraction 
of the distribution below q = 0.5 shrinks with increasing 
size. It is clearly visible that even the smallest sizes are 
far away from the triangular bond q > 0, but the system 
sizes are too small to decide whether q > 0.5 really holds 
for large systems. 




decreases with increasing size, but using a fit I(L) = 
loc + kL~P no decision can be taken if it converges to 
zero. We only provide the result of a fit with 1^ = 0, 
where we get k = 1.2(1) and (3 = -0.61(7). 
Conclusion By the calculation of ground states using 
genetic Cluster-Exact Approximation we find evidence 
for the existence of an ultrametric ground state structure 
in short range ±J spin glasses. For more quantitative 
statements the system sizes are too small, but it is clear 
that the structure is more complex than simply metric. 
For treating larger systems more elaborate algorithms or 
much faster computers must be available, because even 
for our results 32 PPC-601 processors where busy for 
more than three months 24 hours a day. 
For spin glasses with Gaussian distribution the ground 
state is not degenerate, but we expect the same behavior 
as for the ± J model if one allows deviations of order one 
from the true ground state energy, 

Concluding we believe that for realistic spin glasses the 
scenario of an ultrametric organization of the states is 
more probable than a scenario with a simple structure. 
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FIG. 5. Integrated value II 
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+ J gg P2-fi x (q)(q — 0.89)^ dg as function of system size L 
where q € {51, 52, Q3} and qi < q2 < q-i are triples of overlaps 
from independent triples of ground states. Only q-values of 
triples where the two other overlaps are within the interval 
[0.5, 0.6] are used. With increasing system size the fraction of 
the distribution outside [0.5, 0.89] decreases, so the systems 
become more and more ultrametric. The straight line repre- 
sents the function I(L) = 1.2 x L" 61 . 

Fig. U shows the distributions integrated outside the in- 
terval [qfix, qEA] as function of system size. We used 
qEA — 0.89 from the results of plj. The value //, 
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